Teaching Lab End of Year Report: NY_ESMT_IS190
2022-2023 End of Year Report
Background
Teaching Lab collects a variety of data to understand the impact of its PL for educators and students. Please see this resource for a visual overview of our evaluation framework. Additionally, the narrative of our evaluation plan provides more details.
To date (Jun 12, 2023), Teaching Lab has collected the following data during SY22-23:
- 8 complete responses to the End of Session Survey section of the survey that gathers participant feedback on facilitation from session to session;
- 4 complete responses to the End of Course Survey section of the survey that gathers participant feedback on each PL course;
- 1 complete responses to the Baseline Diagnostic Educator Survey that collects information on teachers’ use of curricula, mindsets, self-reported practices, and school environment & 0 responses to the Follow-up Educator Survey.
- 2 observations of classroom instruction.
Below we have compiled the results in various sections: Participant Background and Demographics Summary, Participant Perceptions, Teachers’ Mindsets & School Environment, School Leaders’ Mindsets & Observational Practices and Instructional Practice.
Section 1: Participant Background and Demographics Summary
This section provides a demographic and background summary on participants.
Gender and Racial Identity
Years of Teaching Experience
Content Area
Grades
Prior Experience with Teaching Lab Professional Learning
Roles
Section 2: Participant Perceptions
This section summarizes participants’ feedback on Teaching Lab PL.
- The End of Session survey is collected at the end of each PL course (except the last session) and is focused on feedback for the facilitators.
- The End of Course survey is collected at the end of the last session of a PL course and focuses on feedback for the entire course.
- The Ongoing Coaching Feedback Survey is periodically administered to teachers receiving coaching support to provide feedback on coaches.
- The End of Coaching Feedback Survey is administered at the end of coaching support and provides feedback on the entire coaching experience.
Results are presented in the aggregate and then by each content area.
Section 2a: End of Session Summary
Aggregate
All Races
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Asian
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Black or African American
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Hispanic/Latino
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Math
All Races
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Asian
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Black or African American
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Hispanic/Latino
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
100% strongly agree or agree that the facilitators were fully prepared for the session.
Finally, here are some highlights from the qualitative feedback.
Responses to “What went well in today’s session?”
Responses to “What could have been better about today’s session?”
Responses to “Responses to”What is one thing from today’s learning that you plan to take back to your classroom?”
Responses to “Responses to”What additional feedback do you have about their facilitation skills, if any?”
Section 2b: End of Course Summary
Aggregate
All Races
In summary, we see the following % agree or strongly agree with the
above statements:
75% strongly agree or agree that they were satisfied with how the course was facilitated.
75% strongly agree or agree that they were satisfied with the overall quality of the course.
75% strongly agree or agree that they felt a sense of community with the other participants in the course.
75% strongly agree or agree that they will apply what they have learned in the course to their practice.
75% strongly agree or agree that they looked forward to attending this PL.
67% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 75% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
75% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
100% strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
75% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 75% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
67% strongly agree or agree that the course was relevant to their instructional practices.
75% strongly agree or agree that the PL was a good use of their time.
Asian
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that they were satisfied with how the course was facilitated.
100% strongly agree or agree that they were satisfied with the overall quality of the course.
100% strongly agree or agree that they felt a sense of community with the other participants in the course.
100% strongly agree or agree that they will apply what they have learned in the course to their practice.
100% strongly agree or agree that they looked forward to attending this PL.
100% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 100% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
100% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
100% strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
100% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 100% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
100% strongly agree or agree that the course was relevant to their instructional practices.
100% strongly agree or agree that the PL was a good use of their time.
Black or African American
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that they were satisfied with how the course was facilitated.
100% strongly agree or agree that they were satisfied with the overall quality of the course.
100% strongly agree or agree that they felt a sense of community with the other participants in the course.
100% strongly agree or agree that they will apply what they have learned in the course to their practice.
100% strongly agree or agree that they looked forward to attending this PL.
100% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 100% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
100% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
There is no data to show the % that strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
100% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 100% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
100% strongly agree or agree that the course was relevant to their instructional practices.
100% strongly agree or agree that the PL was a good use of their time.
Other
In summary, we see the following % agree or strongly agree with the
above statements:
0% strongly agree or agree that they were satisfied with how the course was facilitated.
0% strongly agree or agree that they were satisfied with the overall quality of the course.
0% strongly agree or agree that they felt a sense of community with the other participants in the course.
0% strongly agree or agree that they will apply what they have learned in the course to their practice.
0% strongly agree or agree that they looked forward to attending this PL.
0% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 0% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
0% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
There is no data to show the % that strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
0% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 0% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
0% strongly agree or agree that the course was relevant to their instructional practices.
0% strongly agree or agree that the PL was a good use of their time.
Math
All Races
In summary, we see the following % agree or strongly agree with the
above statements:
75% strongly agree or agree that they were satisfied with how the course was facilitated.
75% strongly agree or agree that they were satisfied with the overall quality of the course.
75% strongly agree or agree that they felt a sense of community with the other participants in the course.
75% strongly agree or agree that they will apply what they have learned in the course to their practice.
75% strongly agree or agree that they looked forward to attending this PL.
67% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 75% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
75% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
100% strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
75% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 75% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
67% strongly agree or agree that the course was relevant to their instructional practices.
75% strongly agree or agree that the PL was a good use of their time.
Asian
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that they were satisfied with how the course was facilitated.
100% strongly agree or agree that they were satisfied with the overall quality of the course.
100% strongly agree or agree that they felt a sense of community with the other participants in the course.
100% strongly agree or agree that they will apply what they have learned in the course to their practice.
100% strongly agree or agree that they looked forward to attending this PL.
100% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 100% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
100% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
100% strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
100% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 100% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
100% strongly agree or agree that the course was relevant to their instructional practices.
100% strongly agree or agree that the PL was a good use of their time.
Black or African American
In summary, we see the following % agree or strongly agree with the
above statements:
100% strongly agree or agree that they were satisfied with how the course was facilitated.
100% strongly agree or agree that they were satisfied with the overall quality of the course.
100% strongly agree or agree that they felt a sense of community with the other participants in the course.
100% strongly agree or agree that they will apply what they have learned in the course to their practice.
100% strongly agree or agree that they looked forward to attending this PL.
100% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 100% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
100% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
There is no data to show the % that strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
100% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 100% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
100% strongly agree or agree that the course was relevant to their instructional practices.
100% strongly agree or agree that the PL was a good use of their time.
Other
In summary, we see the following % agree or strongly agree with the
above statements:
0% strongly agree or agree that they were satisfied with how the course was facilitated.
0% strongly agree or agree that they were satisfied with the overall quality of the course.
0% strongly agree or agree that they felt a sense of community with the other participants in the course.
0% strongly agree or agree that they will apply what they have learned in the course to their practice.
0% strongly agree or agree that they looked forward to attending this PL.
0% strongly agree or agree that they talk to other teachers about the things they learned in this PL.- 0% strongly agree or agree that they were fully present “minds-on” during these PL sessions.
0% strongly agree or agree that the activities were well-designed to help them meet the learning targets.
There is no data to show the % that strongly agree or agree that what they’ve learned in this course will improve my supervision of teachers.
0% strongly agree or agree that what they’ve learned in this course will improve my instruction.- 0% strongly agree or agree that the course has supported me in being responsive to students’ backgrounds, cultures, and points of view.
0% strongly agree or agree that the course was relevant to their instructional practices.
0% strongly agree or agree that the PL was a good use of their time.
Several samplings of the textual feedback from the course survey are presented below.
Responses to “Overall, what went well in this course?”
Responses to “Overall, what could have been better in this course?”
Responses to “What is the learning from this course that you are most excited to try out?”
Responses to “Which activities best supported your learning in this course?”
Responses to “Feel free to leave us any additional comments, concerns, or questions.”
Section 3: Teachers’ Mindsets & School Environment
Participants complete Teaching Lab’s Educator Survey twice a year: at the beginning and end of their participation in PL. The survey collects data on teachers’ mindsets, perception and use of curricula, and perceptions of school culture and climate.
Section 3a: Teacher - Mindsets
Teachers responded to several items about mindsets, related to recognizing race and culture, the need for remediation, high expectations for all students, and growth mindsets on a 5-point Likert scale. Composite measures were created for each construct by reverse coding some items and then averaging responses across items. In this way, higher scores correspond to holding equitable mindsets.
The following are average scores by item calculated by the weighted quintile multiplied by a ratio on the scale of 0-1. Higher scores are better
See here for an example.
Overall
Recognition of Race & Culture
High Expectations
Growth Mindsets
Section 3b: Teachers - Perceptions and Use of Curricula
Teachers responded about the different curricula they use regularly and the most often. Overall we see the following results.
Aggregate
Math
Teachers responded about the different curricula they use regularly and the most often. For math we see the following results.
Section 3c: Educators’ Perceptions of School Culture and Climate
Teachers’ Perceptions of School Leaders and CBPL
Teachers responded to items about their perceptions of school leaders and PL environment.
Teachers’ Perceptions of School Environment
Teachers responded to items about their school environment.
Section 4: Teachers’ Instructional Practices
Teachers report on their instructional practices in the Educator Survey and some are observed by Teaching Lab staff.
Section 4a: Teachers’ CRSE Self-Reported Practices
Participants complete Teaching Lab’s Educator Survey twice a year: at the beginning and end of their participation in PL. The survey collects data on self-reported culturally responsive and sustaining education (CRSE) practices.
info@teachinglab.org